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EXACT UPPER AND LOWER BOUNDS ON THE DIFFERENCE BETWEEN 
THE ARITHMETIC AND GEOMETRIC MEANS 


IOSIF PINELIS 


Abstract. Let X denote a nonnegative random variable with EX < oo. Upper and lower 
bounds on E X - exp E In X are obtained, which are exact, in terms of Vx and Ex for 
the upper bound and in terms of Vx and Fx for the lower bound, where Vx '■= Var 's/x, 
E X := E(VX - ?,F X := E(VM*- V*) 2 , mx '.= inf .S’x, Mx '■= supSx, and Sx 
is the support set of the distribution of X. Note that, if X takes each of distinct real values 
xi,... ,x„ with probability 1 /;?, then E X and exp E In X are, respectively, the arithmetic 
and geometric means of x\,... ,x n . 


1. Summary and discussion 

Let SF+ denote the set of all nonnegative random variables (r.v.’s) X with E X < oo. Take 
any X e ,3L ( and let 

V x := Var Vx, mx := inf supp X, Mx := supsuppX, 

(1) E x :=E(yfX- yjmx ) 2 , F x :- E ( \[Mx - Vx) 2 , 

where, as usual, suppX denotes the support of ( the distribution of) the r.v. X. 

It will be shown in this note that 

F x V x 

(2) (2V X ) A * * < EX - exp ElnX < (2V X ) V E x 

F x - V x 

and that each of these two bounds on E X - exp E lnX is exact, in terms of V x and E x for 
the upper bound and in terms of V x and F x for the lower bound. As usual, for any real 
numbers zi, ■ ■ ■ , Z n , we write zi V • • ■ V z n and zi A ■ ■ • A z n for their maximum and minimum, 
respectively. 

Since the r.v. X is nonnegative, clearly m x e [0, oo). However, concerning the value of 
M x one can then only say that M x 6 [m x , oo], with the case M x = oo certainly possible. 
Next, given the condition EX < oo, the values of E x and V x are necessarily finite, and 
hence so is the upper bound in (0. On the other hand, F x - °° if M x - oo; however, 
even then, the lower bound in 0 will of course be finite. Concerning the ratio p* V y x in the 
lower bound in 0, for any V e R, E e R, and F 6 (-oo, oo] we assume the conventions 
that j^y equals V if F - oo and equals 0 if F - V. It will be seen that these conventions 
are the appropriate ones in the present context. 

That the upper and lower bounds in 0 hold and are exact will be established in The¬ 
orem □ below. The statement of Theorem Q] is preceded by three propositions, which 
complement and help understand the main result. 

Take any V 6 R, E e R, and F e (-oo, oo]. 
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Introduce the sets 


(3) ^up -,v,e :={X e X + :V x = V,E x = E], 

(4) X m -yp :={X 6 X + :Vx = V,F x = F}. 

Proposition 1. One has X sup; v,E 4 0 if and only if 

(5) either E = V = 0orE>V>0. 

Similarly, 3fi\ n \- v,f 4 0 if and only if 

(6) either F — V-0orF>V>0. 

All the necessary proofs are given in Section[2] 

Values of V and E as in (0, as well as values of V and F as in 0, may be referred to 
as admissible. 

Proposition 2. If Xnfy,F + 0, then 

FV 

(7) Ev,f ■= ——— = inf {E x : X e Xniyp}- 

F - V 

If moreover, F < oo, then the latter infimum is attained, and it is attained at a r.v. X e 
Xnf ;V,f if and only i/suppX = {m x , M x ) — that is, if and only i/supp X contains at most 
two points. If F = oo, then the infimum in 0 is not attained. 

Proposition 3. Take any X e X+. Then both inequalities in 0 turn simultaneously into 
the equalities if and only if the distribution of the r.v. Vx is the symmetric distribution on 
a set of at most two points in [0, oo). 

Theorem 1. Let 

(8) D x EX-expElnX. 

Then 

(9) S v,e '■= sup {Dx : X e X sup =(2V) V £ if X sup xe 4 0; 

(10) I Vi f := inf {D x '. X e Xrf;v,F} = (2V) A E VF ifX m \. VtF F%. 

These equalities hold if the sets ^ U p;V,£ an d X sup - v,e are replaced there by their respective 
subsets consisting of the r.v.'s in ^ U p;K£ and ^ U p;V,£ taking at most two values. 

Clearly, inequalities 0 and the exactness of the upper and lower bounds in 0 imme¬ 
diately follow from Theorem[l] 

Remark 1. Note that (2V) V E is nondecreasing in V and E, whereas (2V) A Eyj is 
nondecreasing in V and nonincreasing in F (from Eyy+ = 2V down to Ey = V). So, 0 
will hold if the equalities V x — V and E x = E in the definition 0 of X sup .y E are replaced 
by the inequalities V x < V and E x < E. Similarly, <ED will hold if the equalities V x — V 
and F x — F in the definition of 0 of ff\ n \xF are replaced by V x > V and F x < F. 

Moreover, it is now clear that inequalities 0 will hold ifm x and M x in the definitions 
of E x and F x in 0 are replaced, respectively, by any nonnegative a and b such that 
suppX c [a, b]. 

It also follows from the mentioned monotonicity of the exact lower bound 
(2V) A Ev.f in F that the values of this bound are always between V and 2V. □ 
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The lower bound in 0 is an improvement of the zero bound, which follows immediately 
by the Jensen inequality for the (convex) exponential function. In particular, the condition 
E X < oo implies E In X < oo; however, it is possible that E In X = —oo; we use the standard 
conventions InO := -oo and exp(-oo) := 0. 

As for the second inequality in (0, one may consider it as a reverse Jensen inequality; 
cf. e.g. 0. In contrast with the upper bound in 0, the bounds in 0 will be finite only 
when Mx - nix < °°- On the other hand, the bounds in 0 are only for the case when the 
convex function is the exponential one. 

In the case when the r.v. If is a continuous function on the interval [0,1] endowed with 
the Lebesgue measure, obtaining the upper bound ( \jM x - \fmx) 2 on 
EX - exp E In If was presented as Problem 1180 in 0. Note that 2V X = 2Var \fx can 
be rewritten as E ( \[X - Vx )", where X is an independent copy of the r.v. X. Therefore, 
the upper bound in 0 is strictly less than that in 0 unless supp X = {nix,Mx )■ In the 
case when If is a continuous function on the interval [0,1], the latter condition on supp X 
simply means that X is a constant, and then the difference EX - exp EIn X and the upper 
bound on it in 0 (as well as the lower one) are each 0. 

Given any nonnegative real numbers x \,... ,x„, let X be any r.v. with the distribution 
defined by the formula 



(So, in the case when the numbers x\,...,x n are pairwise distinct, any such r.v. X takes 
each of the values x\,...,x n with probability i.) In this case, 

(12) Elf = —-— and exp EIn X = 'ytx i • • • x„. 

n 

Thus, for any r.v. X with Elf < oo, the terms Elf and expEIn X in 0 can be referred 
to, respectively, as the arithmetic and geometric means of the r.v. X. Since any bounded 
nonnegative r.v. can be approximated in distribution by uniformly bounded r.v.’s each tak¬ 
ing finitely many nonnegative real values with equal probabilities, the upper and lower 
bounds in 0 will each remain exact in an appropriate sense if one considers only the r.v.’s 
with such discrete uniform distributions. In particular, one has the following immediate 
corollary from Theorem|T]and RemarkQ] 

Corollary 1. For any n e N, any z = (zi,...,z„) e R", and any function 

/: R —» R, let 

z. := \ (zi + • • • + Zn), z 9 := Vki ■■■z n \, 

Zmax := Zl v • ■ ■ V Zn, z mi „ := Z\ A ■ ■ ■ A z„, /(z) := (/(zi),..., /(z„)). 

Then, for any real V, E, F such that 0 < V < E A F, 

sup {x- x 3 : x -y 2 , y e R", n e N, (y - y) 2 < V, (y - y m in) 2 < E] = (2V) V E, 
inf {x - x 9 : x = /, y e R", n e N, (y-y) 2 > V, (y max - y) 2 < F} - (2 V) A E v ,f. 

The proof of Theorem |T] given in Section [2] relies on the theory of Tchebycheff- 
Markoff systems. Major expositions of this theory and its applications are given in the 
monographs by Karlin and Studden 0 and Krem and Nudel'man 0. A brief review of 
the theory, which contains all the definitions and facts necessary for the proof in the present 
paper, is given in 0- A condensed version of 0 can be found in (8] Appendix A]. 
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2. Proofs 


Proofof Proposition^ Take any X e 3F+. Clearly, Ex > Vx > 0. If Vx — 0 then 
P(Z = c) = 1 for some c e [0, oo), whence Ex = 0, so that Ex — Vx — 0. If Vx > 0 then 
E y/X > frn x and hence Ex > Vx > 0. So, condition (0 is necessary for ,X' S up-.v.r + 0. 
Vice versa, suppose now that (O holds. For any real u and v such that 0 < u < v and any 
p e [0,1], let Y uv . p denote any r.v. such that 

(13) P(T M ,v,p =u)=p= 1 - P(Y u ,v,p = v). 

If E = V = 0 then 0 e Jf SU p ; v,E, and so, -v,e + 0- If now E > V > 0, let X = Y 2 vp with 


(14) 


V 

— and any u and v such that 0 < u < v and v ■ 


y[E~^V 

Then X 6 .Zi'sup.v.F, and so, /Zi'supXF ^ 0 in this case as well. Thus, the equivalence of the 
condition JT sup -, v,e 4 0 and ([5} is checked. The equivalence of the condition ffi n f;V,F 4 0 
and <[6]> is checked quite similarly; here, in the case when F > V > 0, ( 1 1 41 ) is replaced by 

V F 

(15) q := 1 - p = — and any u and v such that 0 < u < v and v — u - -. 

F y/F-V 

Thus, Proposition[T]is proved. □ 

Before proceeding to the proofs of Propositions [2] and [3] let us state the following ob¬ 
servation. 

Lemma 1. Take any r.v. Z such that EZ = 0 and suppZ C [c,d]for some real c and d. 
Then c <0 < d, MatZ < \c\d, and MatZ = \c\d if and only i/suppZ = {[c|, d). 

This follows immediately on noting that c<EZ = 0<a r and VarZ = EZ 2 = E(Z - 
c)(Z — d) — cd < —cd = \c\d. 

Being very simple, Lemma[I]seems to be a piece of common mathematical lore. E.g., 
the inequality VarZ < \c\d in Lemma [T] follows immediately from (2j Lemma 2.2], by 
shifting and rescaling. In the case when Z has a discrete distribution of the form given by 
dTTT) . LemmaQ]was presented as Theorem 1 and second part of Proposition 1 in (l). 

Proof of Proposition^ Suppose that Zfi-v.r 4 0 indeed, and take any X e 3£ m f ; yjr. Let 
Y sjx, a := my, and h My. By Lemma [j] with Z Y - E Y, 

c := a - EY, and d := b - E Y, 

(16) E x = E(F - a) 2 = Var Y + (a - E Y) 2 >\/arY+ = E Vx , Fx = E VJf 

(b — E Y)~ 

provided that oo > F > V - with the inequality in ( IT6l ) turning into the equality if and only 
if supp Y = {niy. My), that is, if and only if supp X — {nix, Mx}- This verifies Proposition^ 
in the case when oo > F > V. 

If now F - V then, by Proposition [I] F — V - 0. In this case, by the convention, 
Ev.f = 0 and, on the other hand, for any X e 3tf m \-, v,f one has supp X = c for some c e R, 
which implies Ex — 0. So, Proposition [2] holds as well in the case when F = V. 

Consider the remaining case, with F — oo. Then, by the convention, Ev.f = V. For each 
s e (0,1), let U B be any r.v. whose distribution is (a mixture of a Bernoulli distribution and 
an exponential distribution) defined by the condition that 


(17) 


Ef(U e ) = (l-e)m + (£- 


s 2 )f(l)+s 2 f 
Jo 


f(x)e x dx 
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for all nonnegative Borel functions / on R. Then E U E = e = Var U E and Fjj e = oo. Let 
now X E := ^ f/ 2 . Then X E e = <%inf;V,F and E Xe = (1 + s)V. So, 

(18) inf [Ex : Xe ^v.f} < inf {(1 +s)V\ ee (0,1)} = V = E V , F . 

On the other hand, 

(19) E x = V x + (m x - E X) 2 ^ V x - V - E VF 

for all X e <Z&i n f;v,F- Now 0 follows as well in the case F — oo. However, in this case 
the infimum in 0 is not attained. Indeed, otherwise the inequality in ( | 1 9t > would for some 
X e i&inf ;v,f turn into the equality, which would imply EX- m x and hence F x = 0, which 
would contradict the assumption F — oo. Thus, Proposition's completely verified. □ 

Proof of Proposition Q] The “if” side of Proposition [3] is quite straightforward to check. 
Let us verify the “only if” side. Suppose that the inequalities in 0 turn simultaneously 
into the equalities, so that the upper and lower bound there are equal to each other, which 
is in turn equivalent to the statement that 

F X V X 

(20) E x < 2V X < * f . 

F x - V x 

If Fx = Vx then, by Proposition Q] V x — 0 and hence suppX = {c} for some c e [0, oo), 
that is, the distribution of Vx is the (necessarily) symmetric distribution on the singleton 
set { Vc) c [0, oo). 

It remains to consider the case Fx > Vx- Then the double inequality (l20l > can be rewrit¬ 
ten as 2V x > Ex V V x , which can be further rewritten as 

Var Y > max[(E Y - a) 1 , (b- E Y) 2 ], 

where Y \[X, a my, and b My, so that a < E Y < b. Therefore, 

(21) 2 Var Y > (E Y - a) 2 + (b - E Y) 2 >2(EY- a){b - E Y) > 2 Var Y, 

where the last inequality follows by Lemma[T|(with Z = Y-E Y). Hence, all the inequalities 
in (|2H are actually the equalities. In particular, the equality 

(EY - a) 2 + (b - E Y) 2 = 2(E Y - a)(b - E Y) implies E Y = (a + b)/2. Also, again 
by LemmaQ] the equality 2(E Y - a)(b - EY) - 2 Var Y implies supp Y = {a,b }. This, 

together with the condition EY - (a + b)/2, shows that the distribution of the r.v. Y = \[X 

is the symmetric distribution on the set {a, b } c [0, oo). This completes the proof of Propo¬ 
sition [3 □ 

The proof of TheoremQ]will be preceded by more notation and two lemmas. Take any 
a and b such that 0 < a < b < oo and introduce 

Q sm v,E :={O8i, 02) 6 (0,<x>) 2 : = V, p 2 ~ 2a/3 l + a 2 = e), 

Qmxf e (0,oo) 2 :{3 2 -p\ = V, fa - 2bff +b 2 = f), 

and then 

(22) :={Te JT +: supp Y c [a,b], E Y = fa, E Y 2 = j3 2 }, 

(23) Spi&i :=sup{Dy2: Y e ^s,,^,}, 

(24) fiijh :=inf{Dy 2 : Y e '3fp i ,p 2 } 

for (J3\,/3 2 ) e (0, oo) 2 , with the definition of D x in ® in mind; for brevity, the dependence 
on a and b is not made explicit in this notation. 
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Lemma 2. Take any (J3 i,02) € Qsup-,v,E such that + 0. Then 

(25) Saa<(2V)V£. 

Lemma 3. 7a£e any (/?i ,/? 2 ) 6 Qj n f ; F,F smc/i that ’3 / /i,p 2 + 0. 77?en 

(26) /„ lA > (2V) A £ VtJ r. 

Proof of Lemma\2\ Note that 

(27) $Pijh =02- exp (2/injgjjgj), where /| n; /j,/j 2 := inf { Eln F: F e $£ lv s 2 }. 

Using HU Proposition 1], it is easy to see that that the sequence of functions 
(l,#,# 2 ,In#) is an M + -system on [ a,b ]. Hence, by 13 part (II)(a) of Proposition 2] (with 
n - 2), the infimum I\ n p t p 2 * s attained at a r.v. of the form Y = Y uv _ p e with 

0<u=a<v<oo and p e [0,1], whose distribution is defined by (fT3l >. These conditions 
on F u v , iP , u, and v, together with the condition (0\ ff ) e <2sup;V,£j allow one to express u, v, 


p> D n„ 
(28) 


V Y 2 , and E Y 2 uniquely in terms of a, V, and E, in accordance with (fTTb : 


a, v - u + 


V 

P= E ’ 


(29) 

(30) 

where 

(31) 

It follows that 

(32) 

(33) 


and u, v, p are as in (1281) ; cf. 
only on V and E. Indeed, 


V£ - / 

D y 2 = pu 2 + qv 2 - u 2p v 2q , 

V Y 2 — pq(v - u) 2 — V, E Y 2 — q(v - a) 2 = q(v - u) 2 = E, 


q := 1 - p. 


SfiulP = *A(0) < sup i //(c), 

CG[— M,Oo) 


where 


f(c) D y 2 = p{u + c) 2 + q{v + c ) 2 - (u + c) 2p {v + c) 2q . 


. The supremum in (l32l) is easy to find, and it depends 


(34) 


t f/"(c) = 4 pq(p - q)(v - uf(u + c) 2p ~ 3 (v + c) 2q ~ 


equals p — q in sign for all c e (-u , oo). To find, for each j e {0,1,2), the limit f^f oo-) 
of the derivative as c —> oo, for any y e R write (v + c) y - (u + c) r (l + e) r , where 


e 


0 and then write 


2 -j 


(1 +e) y = 'Yjjiy- l)---(y-/+ 1)— + o(c J 2 ). 

i=o 1 ' 

Thus, one finds \jj(oo-) = 2 pq(u - v) 2 = 2V and i//(oo-) = f"(oo-) = 0. Therefore and 
because f" equals p-q in sign, one sees that f equals p—q in sign, on the interval (-«, oo), 
which implies that the function f is monotonic on the interval [-u, oo), with iJj(-ii) = 
q{u - v) 2 - E and <//(oo-) = 2V. Thus, the supremum in ( 132) equals (2V) V E, which 
completes the proof of LemrnaO □ 


Proof of Lemma\3\ This proof is similar to that of Lemma[3 Here, instead of the infimum 
defined in (|27] >. one deals with S \np,j3 2 '■= sup { E In F: Ye This supremum 
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is attained at a r.v. of the form Y — Y, 
(35) v = b, i 


u,v,p 6 With 

F 


V 


(36) 


: q(b - uj 1 = q(v ■ 


VF^y 


9= >-? = p 


\ 2 _ 

V - F — 


= E V 


F-V 

u) 2 = F. The proof of Lemma[3] 


VF^y 

D y i as in (l29b . V y 2 = V as in 00b , and F y ^ = p(v 
is concluded with the observation that inf ce [_ u oo ) tfr(c) = (2V) A Eyp - cf. the last sentence 
in the proof of Lemma [2] □ 

Proof of Theorem [7] 

Suppose that 3F SU p,v,E + 0, so that condition © holds. Both sides of <[9]) are obviously 0 if 
E — V = 0. To verify (0 in the remaining case E > V > 0, fix any X « G &sup;v,E- Consider 
first the case 

(37) a := y/m x , > 0 and b := \jM x , < oo. 

Letting now T„ := \pC and (/?*,/?*) := (EY„,EY 2 ), one has ( P\,P* 2 ) e QsupXE and 
Y » G 'S'p’.p;- Also, D x , - D Y i < Sp[j% < ( 2V ) V E, by Lemma|2] So, 

(38) D x , < (2L) V E, 

for any r.v. X. t e 3f SU p\V,E satisfying conditions 63- 

If now a r.v. X t e <i^ U p;V,£ is such that m x , = 0, then D x , < EX', = E x , - E < (2y) V E, 
so that inequality 08b still holds. 

Take now any r.v. X * G ^sup-.v.E such that m x > 0 and M x , = oo. Take then any 
t e (nix,,°°), and let X, X* A t, so that M x , < t < oo, whence, by 08b with X, in place of 
X t , one has Dx, < (2V Xl ) V E Xr On the other hand, by dominated convergence with t —> oo, 
one has Vx, —•> V x , = V, E x , —> E x , - E, EX, —> EX *, and E In A - , —> ElnTL, and so, 
/F; —* D x , ■ 

Thus, inequality (f38l> holds for all X t G ^E S up -,v,e- That is, 

(39) S v ,e<(2V)VE, 

in the case E > V > 0, where S v,e is as in ©. On the other hand, again in the case 
E > V > 0, for any u,v,p as in (IT4t and any c G [-m,oo), the r.v. Y 2 +c v+cp is in ^sup;V,£, 
and so, 

(40) 


S v,E > sup f(c) = (2V) V E, 


ce[—u, oo) 

with as in 03b . This concludes the proof of (j9j. 

The proof of ( TTTTb is similar. Suppose that SF\ n \-y F + 0, so that condition © holds. Both 
sides of (TTTTb are obviously 0 if F - V - 0. Consider the remaining case F > V > 0. 

Fix any X» e fbintv.F- Consider first the case when conditions 07b hold. 

Letting now T* := \fxl and (J3* v f3* 2 ) := (EY,,EY 2 ), one has G ginf;v,f and 

Y, g ’3 / /r r jr 2 - Also, D x - D y i > lp\jr 2 > (2V) a E v ,f, by Lemma[3] So, 

(41) D x , > (2y) A E vf , 

for any r.v. X, G 3F\ n \-,vp satisfying conditions 63. 

Take now any s and t such that 0 < s < t < oo and let X s j := sV(t/\X,,), so that conditions 
07b be satisfied with X SJ in place of X*. Hence, one will have D Xst > (2V Xsl ) A Ev Xu ,f Xu ■ 
Let now s J, 0 and t T o°. Then X KJ —> X r pointwise, m x . —» m x , and M Xu —> M x ,. By 
dominated convergence, E X 2J —» E X, and V x — > V x , = V. If F x , < oo, then F x . —> F Xi , 
again by dominated convergence. If F x , = then clearly F x „ < F x ,- Thus, in any 
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case, lim sup Fx st < Fx, = F. Moreover, by the Fatou lemma, ElnX* < lim inf E In 
whence Dx, > limsupZ>x J( > lim sup \(2Vx SJ ) A Ey x ,f x ] > (2V) A Ev.f, since Ev,f is 
nonincreasing in F and continuous in (V, F) such that F > V > 0. 

Thus, inequality (fTlb holds for all X t e 3C\ n \ xf- That is, 

(42) lyp ^ (2V) A Eyp, 

in the case F > V > 0, where lyp is as in dTOb . On the other hand, again in the case 
F > V > 0, for any u, v,p as in (TT3] > and any c e [-u, oo), the r.v. T^ +CjV+ is in SF\ n \y,F, 
and so, 

(43) lyp < inf I //(c) = (2V) A Eyp, 

ce[-u,oo) 

with still as in (l33l >. This concludes the proof of (ITOl) . 

Concerning the last sentence of Theorem [Q let ^ S up, 2 ;V,E denote the set of all r.v.’s 
in ^F S up;V,E taking at most two values, and then let S 2 ; y E sup \D X : X e ^sup, 2 ;V,e}- 
Suppose that ^ U p;V,£ ^ 0, as is done in ©, so that (0 holds. 

If E = V — 0, then Syp - 0 and, on the other hand, 0 6 ^sup, 2 ;V,£ and hence 0 = Z>o < 
S 2;V,E ^ SyE - 0, SO that S 2 -yE — S yE — (2 V) V E. 

Suppose now that E > V > 0. Then for any u, v, p as in (IT4l > and any c e [—u, oo) 
one has Y% e ^sup. 2 ; v,£ and hence, by (l40b and (f33l >. (2V) V E = sup cet _ uoo) if/(c) - 
su P c6 [-«,oo) < 5 2 -v,E < Sy E - (2V) V E, and so, the conclusion S 2 -v,e = Sy E = 

(2 V) V E holds. 

That is, the equality in ® holds if the set 3F S up-,v,E is replaced there by ^ U p, 2 ;V,£- The 
corresponding statement concerning the equality in (ITOl) and the set .% n f-v.E is verified quite 
similarly. 

Thus, Theorem|T|is completely proved. □ 
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